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TITLE OF THE INVENTION 
SIGNAL PROCESSING APPARATUS AND 
IMAGE DATA GENERATION APPARATUS 

5 FIELD OF THE INVENTION 

The present Invention relates to a signal 
processing apparatus and an image data generation 
apparatus that have both optical and electrical zoom 
means . 

10 

BACKGROUND OF THE INVENTION 

In recent years , image recording apparatuses ( or 
signal processing apparatuses or image data generation 
apparatuses) such as digital video cameras and digital 

15 (still) cameras are widely used in the ordinary 

household. Such image recording apparatuses generally 
have a zoom function capable of continuously changing 
the photographing view angle from a wide-angle mode to 
a telephoto mode by user operation. Many image 

20 recording apparatuses have even an electrical zoom 
function of electronically variably magnifying 
photographing image data in addition to a conventional 
optical zoom function using a zoom lens optical system. 
Fig. 26 is a block diagram showing the schematic 

25 arrangement of a conventional image recording apparatus 
having an optical zoom function and an electrical zoom 
function. Referring to Fig. 26, a lens optical system 
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2301 Includes an optical lens which forms an Image of 
Incident light on an Image sensing element 2302, an 
aperture, a focus controller, various kinds of optical 
filters, and a driving mechanism for them. The lens 
5 optical system 2301 can execute optical zoom for 
optically changing the view angle and Includes a 
driving mechanism for It . 

The above -described optical mechanism In the lens 
optical system 2301 of the Image recording apparatus 

10 shown In Fig. 26 Is a common mechanism, and a 

description thereof will be omitted. The Image sensing 
element 2302 converts the optical signal of an Image 
formed on the light -receiving surface by the lens 
optical system 2301 Into an electrical signal. For 

15 example, a CCD (Charge Coupled Device) and a CMOS 

(Complementary Metal Oxide Semiconductor) sensor are 
known . 

An A/D ( Analog- to-Dlgltal conversion) circuit 
2303 converts the Image sensing signal, which has been 

20 converted Into an electrical signal by the Image 

sensing element 2302, Into digital Image sensing data 
(to be referred to as Image sensing data hereinafter). 
A memory 1 (2304) stores the Image sensing data 
converted by the A/D circuit 2303. At this point of 

25 time, the Image sensing data Is digital data In an 

output format unique to the Image sensing element (the 
output format changes depending on the pixel array and 
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the color filter array) . A camera signal processing 
circuit 2305 executes various processing operations for 
converting the image sensing data supplied from the 
memory 1 (2304) into image data. A zoom control 
5 circuit 2307 controls an optical zoom control circuit 
2306 in accordance with input from a zoom operation key 
2310. The zoom control circuit 2307 also controls an 
enlargement processing circuit 2309 through a switch 
2308. The optical zoom control circuit 2306 controls 

10 the lens optical system 2301 to perform optical zoom 
under the control of the zoom control circuit 2307. 
The enlargement processing circuit 2309 executes 
electrical zoom processing under the control of the 
zoom control circuit 2307. That is, the zoom control 

15 circuit 2307 allows optical zoom or electrical zoom 
processing. 

An electrical zoom ON/OFF switch 2311 turns 
on/off the electrical zoom function. When the 
electrical zoom ON/OFF switch 2311 is OFF, the switch 

20 2308 is turned off to inhibit the enlargement 

processing circuit 2309 from executing enlargement 
processing. When the electrical zoom ON/OFF switch 
2311 is ON, the switch 2308 is turned on to cause the 
enlargement processing circuit 2309 to execute 

25 enlargement processing. The electrical zoom ON/OFF 
switch 2311 is prepared for users who dislike a 
degradation in image quality due to enlargement by 
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electrical zoom so that photographing can be executed 
while setting the zoom control mode for only optical 
zoom. 

A memory 2 (2312) stores image data which has 
5 undergone camera signal processing and enlargement 

processing. A recording signal processing circuit 2313 
executes compression -coding, recording format 
generation, error- correcting coding, or recording 
modulation coding for the image data read out from the 

10 memoiY 2 (2312). A recording medium 2314 records the 

image data processed by the recording signal processing 
circuit 2313. 

The optical zoom and electrical zoom operations 
in the image recording apparatus shown in Fig. 26 will 

15 be described next. 

Fig. 27 is a view showing the optical zoom and 
electrical zoom operations in the image recording 
apparatus shown in Fig. 26. A frame 2401 indicates the 
range of the object (including a tree, a skier, and a 

20 cloud) of image data stored in the memory 1 (the freune 
2401 indicates the view angle). The frame 2401 becomes 
large as the optical zoom shifts to the wide-angle 
side. More specifically, in a zoom control region 2406 
for optical zoom, when the lens optical system 2301 is 

25 controlled to the maximum wide-angle state, the frame 
2401 becomes large. At that view angle, a wide-angle 
image 2403 is obtained. Accordingly, the image data of 
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the object Indicated by the wide-angle Image 2403 Is 
stored In the memory 1 . In the zoom control region 
2406, when the lens optical system 2301 is controlled 
to the mcLximum telephoto state, a telephoto image 2404 
5 is obtained at the view angle corresponding to the 

frame 2401. Accordingly, the image data of the object 
indicated by the telephoto image 2404 is stored in the 
memory 1 . As described above , the image recording 
apparatus shown in Fig. 26 executes the zoom operation 
10 by changing the photographing view angle (the range of 
the freime 2401) by controlling the lens optical system 
2301. 

On the other hand, in a zoom control region 2407 
for electrical zoom, a partial area indicated by a 
15 frame 2402 is extracted and enlarged from the image 

data of the object within the frame 2401 in the maximum 
telephoto state, thereby obtaining an electrical zoom 
image 2405. 

At this time, the image quality degrades to some 
20 extent in electrical zoom processing, as described 
above. Especially, when the magnification ratio of 
electrical zoom is high, the image quality largely 
degrades. To prevent this, the magnification ratio of 
electrical zoom is generally limited by defining an 
25 upper limit value. 

There is also disclosed an information recording 
apparatus (image recording apparatus) capable of 
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preventing any unintentional degradation in image 
quality by excessive electrical zoom processing (e.g., 
Japanese Patent Laid-Open No. 2001-197347). In this 
apparatus, when electrical zoom processing may cause an 
5 undesirable degradation in image quality, the 

electrical zoom processing is restricted, or a warning 
is displayed. 

More specifically, the information recording 
apparatus comprises an image sensing unit which senses 

10 an image, and an electrical zoom processing unit which 
acquires a selected image within a predetermined range 
from the image obtained by the image sensing unit and 
converts the selected image into an output image having 
a predetermined number of pixels . The electrical zoom 

15 processing unit has a selection range condition setting 
function of setting a condition to be satisfied by the 
selected image by referring to the number of pixels of 
the output image. The apparatus further comprises a 
notification unit which notifies a user that the 

20 condition is not satisfied when the selected image does 
not satisfy the condition. With the above -described 
arrangement, when electrical zoom processing may cause 
an undesirable degradation in image quality, the 
electrical zoom processing can be restricted, or a 

25 warning can be displayed. 

Some signal processing apparatuses and image data 
generation apparatuses , which have come along in recent 
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years, record reduced Image data smaller than the Image 
size of the Image sensing element In some recording 
modes , as in the moving Image photographing mode of a 
digital video camera having a still Image photographing 
5 function. In such signal processing apparatuses and 
Image data generation apparatuses, even when 
photographing Is performed by setting for only optical 
zoom, the Image data Is further reduced electronically 
and recorded In some recording modes. That Is, setting 

10 for electrical zoom is not done in consideration of the 
electronic reduction. In other words, it is 
Inconsistent with the primary purpose of the 
photographing mode which prevents, by electrical zoom 
ON/OFF setting, the degradation in image quality by 

15 enlargement processing. 

SUMMARY OF THE INVENTION 
The present invention has been made in 
consideration of the above -described problem, and has 
20 as its main object to provide a signal processing 

apparatus and an image data generation apparatus, which 
allow a user to select a zoom mode with a small 
degradation in image quality in electrical zoom 
processing. 

25 According to an aspect of the present invention, 

signal processing apparatus which changes a 
magnification ratio of an image acquired by image 
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sensing means, characterized by comprising: first 
signal processing means for executing first signal 
processing for reducing an image sensing signal with 
respect to a scanning range of an obtained image 
5 sensing surface when the magnification ratio of the 
image is to be increased; second signal processing 
means for executing second signal processing different 
from the first signal processing to change the 
magnification ratio of the image; first detection means 

10 for detecting selection of one of a telephoto side and 
a wide-angle side; second detection means for detecting 
a limit of an increase in magnification ratio of the 
image by the first signal processing; and selection 
means for selecting one of a first mode and a second 

15 mode; wherein when the first mode is selected by the 

selection means, and the first detection means detects 
that the telephoto side is continuously selected, the 
first signal processing is executed, and when the 
second detection means detects that the increase in 

20 magnification ratio of the image by the first signal 
processing has reached the limit, the second signal 
processing is subsequently executed to enlarge the 
image, and when the second mode is selected by the 
selection means, even when the second detection means 

25 detects that the Increase in magnification ratio of the 
image by the first signal processing has reached the 
limit, and the first detection means then detects that 
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the telephoto side Is continuously selected, the second 
signal processing Is Inhibited. 

According to another aspect of the present 
Invention, an Image recording apparatus characterized 
5 by comprising a signal processing apparatus of the 

present Invention; and optical variable magnification 
means for changing a view angle of an object Image 
formed on a light -receiving surface of Image sensing 
means, wherein variable magnification by the optical 

10 variable magnification means Is executed In first 
signal processing . 

According to further aspect of the present 
Invention, an Image data generation apparatus which 
generates Image data on the basis of Image sensing data 

15 photographed by an Image sensing element, characterized 
by comprising: recording mode control means for 
controlling a first recording mode In which Image data 
In a first Image format having a first Image size 
corresponding to the number of pixels of the Image 

20 sensing element Is generated and recorded, and a second 
recording mode In which Image data In a second Image 
format having a second Image size smaller than the 
first Image size Is generated and recorded; electronic 
variable magnification means for executing electronic 

25 variable magnification processing In generating the 
Image data In the second Image format In the second 
recording mode; maximum variable magnification ratio 
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setting means for setting a maximum variable 
magnification ratio In the electronic variable 
magnification means; and variable magnification ratio 
change Indication means for Indicating a change In 
5 variable magnification ratio while defining, as a 

maximum value, the maximum variable magnification ratio 
set by the maximum variable magnification ratio setting 
means, wherein the maximum variable magnification ratio 
setting means sets, as the maximum variable 

10 magnification ratio, a maximum variable magnification 
ratio candidate selected by a user from a plurality of 
types of mcLxlmum variable magnification ratio 
candidates, and the variable magnification ratio change 
indication means indicates, as a boundary line, a value 

15 of a maximum variable magnification ratio candidate 

whose variable magnification ratio is lower than that 
of the maximum variable magnification ratio. 

According to yet further aspect of the present 
invention, a signal processing method of changing a 

20 magnification ratio of an image acquired by image 

sensing means, characterized by comprising: a first 
signal processing step of executing first signal 
processing for reducing an image sensing signal with 
respect to a scanning range of an obtained image 

25 sensing surface when the magnification ratio of the 
image is to be Increased; a second signal processing 
step of executing second signal processing different 
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from the first signal processing step to change the 
magnification ratio of the Image; a first detection 
step of detecting selection of one of a telephoto side 
and a wide-angle side; a second detection step of 
5 detecting a limit of an Increase In magnification ratio 
of the Image by the first signal processing step; and 
selection step of selecting one of a first mode and a 
second mode; wherein In the selection step, when the 
first mode Is selected, and It Is detected In the first 

10 detection step that the telephoto side Is continuously 
selected, the first signal processing Is executed, and 
when It Is detected In the second detection step that 
the Increase In magnification ratio of the Image by the 
first signal processing has reached the limit, the 

15 second signal processing Is subsequently executed to 
enlarge the Image, and when the second mode Is 
selected, even when It Is detected In the second 
detection step that the Increase In magnification ratio 
of the Image by the first signal processing has reached 

20 the limit, and It Is then detected In the first 

detection step that movement from the wide-angle side 
to the telephoto side Is continuously selected, the 
second signal processing Is Inhibited. 

According to another aspect of the present 

25 Invention, an Image data generation method for 

generating Image data on the basis of Image sensing 
data photographed by an Image sensing element. 
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characterized by comprising: a recording mode control 
step of controlling a first recording mode In which 
image data in a first image format having a first image 
size corresponding to the number of pixels of the image 
5 sensing element is generated and recorded, and a second 
recording mode In which image data in a second image 
format having a second image size smaller than the 
first image size is generated and recorded; an 
electronic variable magnification step of executing 

10 electronic variable magnification processing in 

generating the image data in the second image format in 
the second recording mode; a mcixlmum variable 
magnification ratio setting step of setting a maximum 
variable magnification ratio in the electronic variable 

15 magnification step; and a variable magnification ratio 
change indication step of indicating a change in 
variable magnification ratio while defining, as a 
maximum value, the maximum variable magnification ratio 
set in the maximum variable magnification ratio setting 

20 step, wherein in the maximum variable magnification 
ratio setting step, a maximum variable magnification 
ratio candidate selected by a user from a plurality of 
types of maximum variable magnification ratio 
candidates is set as the maximum variable magnification 

25 ratio, and in the variable magnification ratio change 
indication step, a value of a maximum variable 
magnification ratio candidate whose variable 
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magnification ratio Is lower than that of the maximum 
variable magnification ratio Is Indicated as a boundary 
line . 

According to another aspect of the present 
5 invention, a program for a signal processing apparatus 
which changes a magnification ratio of an image 
acquired by image sensing means, characterized by 
comprising: a first signal processing step of executing 
first signal processing for reducing an image sensing 

10 signal with respect to a scanning range of an obtained 
image sensing surface when the magnification ratio of 
the image is to be increased; a second signal 
processing step of executing second signal processing 
different from the first signal processing step to 

15 change the magnification ratio of the image; a first 
detection step of detecting selection of one of a 
telephoto side and a wide-angle side; a second 
detection step of detecting a limit of an Increase in 
magnification ratio of the image by the first signal 

20 processing step; and selection step of selecting one of 
a first mode and a second mode; wherein the signal 
processing apparatus is caused to, in the selection 
step, when the first mode is selected, and it is 
detected in the first detection step that the telephoto 

25 side is continuously selected, execute the first signal 
processing, and when it is detected in the second 
detection step that the increase in magnification ratio 
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of the Image by the first signal processing has reached 
the limit, subsequently execute the second signal 
processing to enlarge the image, and when the second 
mode is selected, even when it is detected in the 
5 second detection step that the increase in 

magnification ratio of the image by the first signal 
processing has reached the limit, and it is then 
detected in the first detection step that movement from 
the wide-angle side to the telephoto side is 
10 continuously selected, inhibit the second signal 
processing. 

According to still another aspect of the present 
invention, a progreun for an image data generation 
apparatus which generates image data on the basis of 

15 image sensing data photographed by an image sensing 

element, characterized by comprising: a recording mode, 
control step of controlling a first recording mode in 
which image data in a first image format having a first 
image size corresponding to the number of pixels of the 

20 image sensing element is generated and recorded, and a 
second recording mode in which image data in a second 
image format having a second image size smaller than 
the first image size is generated and recorded; an 
electronic variable magnification step of executing 

25 electronic variable magnification processing in 

generating the image data in the second image format in 
the second recording mode; a maximum variable 
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magnification ratio setting step of setting a maximum 
variable magnification ratio In the electronic variable 
magnification step; and a variable magnification ratio 
change Indication step of Indicating a change In 
5 variable magnification ratio while defining, as a 

maximum value, the maximum variable magnification ratio 
set in the maximum variable magnification ratio setting 
step, wherein the image data generation apparatus is 
caused to, in the maximum variable magnification ratio 

10 setting step, setting, as the maximum variable 

magnification ratio, a maximum variable magnification 
ratio candidate selected by a user from a plurality of 
types of maximum variable magnification ratio 
candidates , and in the variable magnification ratio 

15 change indication step, indicating, as a boundary line, 
a value of a mcLKlmum variable magnification ratio 
candidate whose variable magnification ratio Is lower 
than that of the maximum variable magnification ratio. 
According to another aspect of the present 

20 invention, an image sensing apparatus which has an 

optical zoom function and an electrical zoom function 
and in which a sensed image at a photographing 
magnification ratio covered by the optical zoom 
function is recorded as a reduced image obtained by 

25 reducing the sensed image to an image having a 

predetermined number of pixels smaller than the number 
of pixels of the sensed image, and when photographing 
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at a magnification ratio more than a msixlmum 
photographing magnification ratio covered by the 
optical zoom function Is Instructed, an image generated 
from the sensed image by using the electrical zoom 
5 function is recorded, characterized by comprising: 

storage means for storing a set value representing, of 
photographing magnification ratios that the electrical 
zoom function copes with, a maoclmum magnification ratio 
to be used in image sensing; first electrical zoom 

10 means for extracting the image having the predetermined 
number of pixels from the sensed image to obtain an 
enlarged image; second electrical zoom means for 
extracting a partial image of the enlarged image and 
enlarging the partial image to the image having the 

15 predetermined number of pixels to obtain an enlarged 

image; and switching means for switching, in accordance 
with the set value, between image sensing which is to 
be executed by using both of the first electrical zoom 
means and the second electrical zoom means and image 

20 sensing which is to be executed by using only the first 
electrical zoom means. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 

25 drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings , which are incorporated 
in and constitute a part of the specification, 
5 illustrate embodiments of the invention and, together 
with the description, serve to explain the principles 
of the invention. 

Fig. 1 is a block diagram showing the schematic 
arrangement of a digital video camera according to the 
10 first embodiment of the present invention; 

Fig, 2 is a block diagram showing details of a 
camera signal processing circuit 104 shown in Fig. 1; 

Fig. 3 is a block diagram showing the schematic 
arrangement of a reduction processing circuit 205 shown 
15 in Fig. 2; 

Fig. 4 is a graph showing a setting example of a 
variable spatial LPF in the horizontal direction 
corresponding to the reduction ratio; 

Fig. 5 is a block diagram showing the schematic 
20 arrangement of an enlargement processing circuit 206 
shown in Fig. 2; 

Fig. 6 is a graph showing a control excunple in 
which the gain of an edge enhancement signal in 
aperture correction processing is increased in 
25 proportion to the enlargement ratio; 

Fig. 7 is a block diagram showing the schematic 
arrangement of a variable magnification processing 
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circuit 204a which has an arrangement different from 
that of the variable magnification processing circuit 
204 shown in Figs. 2, 3, and 5; 

Fig. 8 is a view showing the outline of still 
5 image/moving image mode change in the digital video 
camera shown in Fig. 1; 

Fig. 9 is a view showing the outline of a zoom 
operation in the second recording mode in the digital 
video camera shown in Fig. 1; 
10 Fig. 10 is a view showing an example of zoom 

magnification ratio indication on a viewfinder 114 in 
which a photographing image is confirmed; 

Figs. IIA to lie are views showing display 
examples of boundary lines between variable 
15 magnification ratios on a zoom magnification ratio 
indicator 1001; 

Figs. 12A to 12C are views showing examples of 
the zoom magnification ratio indicator 1001 different 
from Figs. IIA to IIC; 
20 Fig. 13 is a view showing a detailed example of a 

maximum magnification ratio selection switch 111; 

Fig. 14 is a flow chart showing the operation 
flow of zoom processing corresponding to mode setting 
in the digital video Ccunera according to the first 
2 5 embodiment ; 

Fig. 15 is a flow chart showing the operation 
flow of zoom processing corresponding to mode setting 
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in the digital video camera according to the first 
embodiment ; 

Fig. 16 is a flow chart showing the operation 
flow of zoom processing corresponding to mode setting 
5 in the digital video camera according to the first 
embodiment ; 

Fig. 17 is a block diagram showing the schematic 
arrangement of a digital video camera according to the 
second embodiment of the present invention; 
10 Fig. 18 is a block diagram for explaining details 

of a camera signal processing circuit 104a shown in 
Fig. 17; 

Fig. 19 is a view showing the outline of zoom 
processing in a second photographing mode; 
15 Fig. 20 is a block diagram showing the schematic 

arrangement of a digital video camera according to the 
third embodiment of the present invention; 

Fig. 21 is a block diagram for explaining details 
of a Ccimera signal processing circuit 104b shown in 
20 Fig. 20; 

Fig. 22 is a view showing the outline of a zoom 
processing operation in the digital video camera shown 
in Fig. 20; 

Figs. 23A and 23B are views showing examples of 
25 zoom magnification ratio indication on a viewfinder 114 
in which a photographing image is confirmed; 

Figs. 24A and 24B are views showing examples of a 
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zoom magnification ratio Indicator 2000 different from 
Figs. 23A and 23B; 

Fig. 25 is a view showing a detailed example of a 
maximum magnification ratio selection switch 111a; 
5 Fig. 26 is a block diagram showing the schematic 

arrangement of a conventional image recording apparatus 
having an optical zoom function and an electrical zoom 
function; and 

Fig. 27 is a view showing the optical zoom and 
10 electrical zoom operations in the image recording 
apparatus shown in Fig. 26. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Preferred embodiments of the present invention 
15 will now be described in detail in accordance with the 
accompanying drawings. 

The schematic arrangement of a digital video 
camera (an image recording apparatus, signal processing 
apparatus, or image data generation apparatus) 
20 according to the first embodiment of the present 

invention will be described first. The digital video 
camera of this embodiment can photograph both a still 
image and a moving image. 

Fig. 1 is a block diagram showing the schematic 
25 arrangement of the digital video camera according to 
the first embodiment of the present invention. 
Referring to Fig. 1, a lens optical system 101 Includes 
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an optical lens which forms an Image of Incident light 
on an Image sensing element 102, an aperture, a focus 
controller, various kinds of optical filters, and a 
driving mechanism for them. The lens optical system 
5 101 can execute optical zoom for optically changing the 
view angle and Includes a driving mechanism for It . 
The above-described optical mechanism In the lens 
optical system 101 of the digital video ccunera shown In 
Fig. 1 Is a common mechanism, and a detailed 

10 description thereof will be omitted. 

The Image sensing element 102 converts the 
optical signal of an Image formed on the 
light -receiving surface by the lens optical system 101 
Into an electrical signal. Examples of the Image 

15 sensing element 102 are a CCD (Charge Coupled Device) 
and a CMOS (Complementary Metal Oxide Semiconductor) 
sensor. An A/D (Analog/Digital) circuit 103 
analog/dlgltal-converts the Image sensing signal, which 
has been converted Into an electrical signal by the 

20 Image sensing element. Into digital Image sensing data 
(to be referred to as Image sensing data hereinafter). 
At this point of time, the Image sensing data Is 
digital data In an output format unique to the Image 
sensing element 102 (the output format changes 

25. depending on the pixel array, the color filter array, 
and the pixel charge read method) . 

A camera signal processing circuit 104 executes 
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various processing operations for converting the image 
sensing data supplied from the A/D circuit 103 into 
image data. The camera signal processing circuit 104 
also controls the optical zoom driving mechanism of the 
5 lens optical system 101 to execute optical zoom. The 
processing executed by the camera signal processing 
circuit 104 will be described later in detail. A 
recording signal processing circuit 105 executes 
compression-coding, recording format generation, 

10 error- correcting coding, or recording modulation coding 
for the image data converted by the ceunera signal 
processing circuit 104. The recording signal 
processing circuit 105 outputs recording image data to 
be recorded in a recording medium. A recording medium 

15 106 records the recording image data generated by the 
recording signal processing circuit 105. Examples of 
the recording medium 106 are a flexible disk and a 
magnetic tape. 

A recording mode switch 107 can be switched by a 

20 user to set a recording mode. In a recording mode of 
this embodiment , the type of image data to be recorded 
is switched between still image data and moving image 
data, or the recording image size is changed. A 
recording mode control circuit 108 controls the 

25 contents of processing by the driving circuit of the 

image sensing element 102, the camera signal processing 
circuit 104, and the recording signal processing 
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Circuit 105 In accordance with the setting of the 
recording mode switch 107. The processing In the 
recording mode control circuit 108 will be described 
later In detail . 
5 A maximum magnification ratio setting circuit 109 

sets the maximum magnification ratio In a zoom 
operation In accordance with the setting of a maximum 
magnification ratio selection switch 111. The setting 
by the maximum magnification ratio setting circuit 109 

10 will be described later In detail. A zoom 

magnification ratio Indication circuit 110 displays 
Information related to the zoom magnification ratio on 
a vlewflnder 114 (to be described later). More 
specifically, as shown In Fig. 10, a character 

15 representing the current zoom magnification ratio Is 
displayed (displayed as an Indicator) on a scale 
representing the maximum wide-angle state and the 
maximum telephoto state. Fig. 10 will be described 
later In detail. With a zoom operation key 112, the 

20 operator Inputs the zoom operation between the 
wide-angle state and the telephoto state. 

A display control circuit 113 displays an Image, 
which Is being photographed, on the vlewflnder 114 on 
the basis of Image data output from the camera signal 

25 processing circuit 104, or displays the zoom 

magnification ratio for the zoom magnification ratio 
Indication circuit 110 on the vlewflnder 114. The 
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vlew£lnder 114 Is a display circuit on which various 
kinds of information are displayed under the control of 
the display control circuit 113. An example of the 
vlewflnder 114 Is a liquid crystal display circuit. 
5 The digital video camera shown In Fig* 1 

comprises not only the components shown In Fig. 1 but 
also constituent components prepared In common digital 
video cameras. Including a system controller, a 
recording medium driving circuit , and a user Interface 

10 circuit. However, these constituent components are 
unnecessary for the description of the embodiment of 
the present invention and therefore are not 
Illustrated. 

The processing in the recording mode control 

15 circuit 108 in the digital video camera shown in Fig. 1 
will be described in detail. The digital video camera 
shown in Fig. 1 has a still image mode in which a still 
image is photographed and a moving image mode in which 
a moving image is photographed, as described above. 

20 When the operator switches the recording mode switch 
107, the mode can be changed between the still image 
mode and the moving image mode under the control of the 
recording mode control circuit 108. Fig. 8 is a view 
showing the outline of still image/moving image mode 

25 change in the digital video camera shown in Fig. 1. 

Referring to Fig. 8, a sensing image size 801 
represents the image size of image sensing data 
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Obtained by causing the A/D circuit 103 to convert an 
Image sensing signal output from the Image sensing 
element 102 into digital data. A still image size 802 
represents the image size of still image data which is 
5 generated by the digital video camera on the basis of 
image sensing data when the recording mode is the still 
image mode. A moving image size 803 represents the 
image size of moving image data which is generated by 
the digital video camera on the basis of image sensing 

10 data when the recording mode is the moving image mode. 

An image size is defined by the total nximber of 
pixel data contained in image data. As shown in 
Fig. 8, for the still image size 802, Ccunera signal 
processing is executed in the same image size as the 

15 sensing image size 801. However, for the moving image 
size 803, camera signal processing is executed in an 
image size obtained by reducing the sensing image size 
801 in accordance with the moving image data format. 

The reason why image size reduction processing is 

20 necessary in the moving image mode, as described above, 
will be described below. In, e.g., a digital video 
format (to be referred to as a DV format hereinafter), 
the image size of moving image data is predetermined. 
For this reason, if the image size of image sensing 

25 data is larger than the predetermined size, the image 
data must be reduced to the predetermined size. Hence, 
the digital video camera shown in Fig. 1 reduces image 
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data to the image size corresponding to the DV format 
In the moving image mode. 

To the contrary, the image size of still image 
data photographed in the still image mode is not 
5 particularly predetermined in the still image format. 
Still image data can be recorded up to the maximum 
image size defined by each digital video camera. 

An excunple of the driving processing of the image 
sensing element 102 corresponding to switching between 

10 the still image mode and the moving image mode 

described above is switching between a cumulative read 
in the moving .image mode and a non- cumulative read in 
the still image mode. In addition, as the processing 
by the recording signal processing circuit 105 

15 corresponding to switching between the still image mode 
and the moving image mode, switching is executed 
between compression-coding, recording format 
generation, error -correcting coding, and modulation 
coding corresponding to each of the DV format and still 

20 image format defined by setting the still or moving 
image mode. 

In the following description, the first recording 
mode is the still image mode, and the second recording 
mode is the moving image mode. The first and second 
25 recording modes are not limited to the above -described 
modes and can be two recording modes using different 
electronic enlargement /reduction processes. For 
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example, the first recording mode is the 

above -described mode (still image mode), and the second 
recording mode may be a still image reduction recording 
mode in which still image data is electronically 
5 reduced . 

The camera signal processing circuit 104 shown in 
Fig. 1 will be described next in detail. 

Fig. 2 is a block diagram showing details of the 
camera signal processing circuit 104 shown in Fig. 1. 

10 Referring to Fig. 2, an image sensing data input 

terminal 201 is connected to the output terminal of the 
A/D circuit 103 to receive image sensing data output 
from the A/D circuit 103. A memory 1 (202) is a 
storage circuit which holds the image sensing data 

15 input to the image sensing data input terminal 201. 

The image sensing data held in the memory 1 (202) has a 
format which changes depending on the structure or 
driving method of the image sensing element 102, as 
described above. An example of the format of the image 

20 sensing data is a data format determined by the color 
filter array of a color image sensing element. 

An image sensing signal processing circuit 203 
converts the image sensing data held in the memory 1 
(202) into an image data format for recording or an 

25 intermediate image data format for the next processing. 
More specifically, since image sensing element 102 of 
this embodiment is a color image sensing element, the 



- 27 - 



CFM03494/P204-0054 



Image sensing signal processing circuit 203 executes 
matrix conversion processing from the Image sensing 
data to image data In the RGB format or Image data In 
the y(R-Y){B-Y) format, interpolation processing for 
5 the color filter array, white balance processing, and 
T conversion processing. The conversion parameters of 
these processing operations are controlled by recording 
mode data supplied from a recording mode input terminal 
210 (to be described later). 

10 A variable magnification processing circuit 204 

executes enlargement /reduction processing for the image 
data output from the image sensing signal processing 
circuit 203 and outputs the variably magnified image 
data. More specifically, the variable magnification 

15 processing circuit 204 comprises a reduction processing 
circuit 205, enlargement processing circuit 206, and 
variable magnification processing selection circuit 
207. The reduction processing circuit 205 executes 
reduction processing for the image data and outputs 

20 reduced image data. It is detected whether the 

reduction processing for the image data has reached its 
limit. If it is detected that the reduction processing 
for the image data has reached the limit, the 
enlargement processing circuit 206 executes enlargement 

25 processing for the image data and outputs enlarged 
image data. The variable magnification processing 
selection circuit 207 selects one of the image data. 
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reduced Image data, and enlarged Image data In 
accordance with the mode and outputs variably magnified 
image data. A memory 2 (208) holds the variable 
magnified image data output from the variable 
5 magnification processing circuit 204. A terminal 209 
outputs the variably magnified image data (image data 
in the second image format) held in the memory 2. 

Recording mode data from the recording mode 
control circuit 108 shown in Fig. 1 is input to the 

10 recording mode input terminal 210 (to be referred to as 
the terminal 210 hereinafter) . More specifically, 
recording mode data which designates the first 
recording mode (still image recording mode) or the 
second recording mode (moving image mode) is input. 

15 The above -described image sensing signal processing 

circuit 203 executes signal processing corresponding to 
the recording mode data input from the terminal 210. 
More specifically, the image sensing signal processing 
circuit 203 executes processing for generating still 

20 image data from the image sensing data in accordance 
with the first recording mode (still image mode) or 
processing for generating reduced moving image data 
from the image sensing data in accordance with the 
second recording mode (moving image mode). A zoom 

25 control circuit 211 and an electronic variable 
magnification control circuit 212 (both will be 
described later) control a zoom operation corresponding 
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to the recording mode data input from the terminal 210. 

The zoom control circuit 211 determines the zoom 
magnification ratio In accordance with zoom operation 
key Input data from a zoom operation key Input terminal 
5 213 (to be referred to as a terminal 213 hereinafter) 
and controls an optical zoom control circuit 216 (to be 
described later) and the electronic variable 
magnification control circuit 212 In a mode 
corresponding to the determined zoom magnification 

10 ratio to execute the zoom operation. The electronic 
variable magnification control circuit 212 controls 
variable magnification processing by the variable 
magnification processing circuit 204 In accordance with 
an Instruction from the zoom control circuit 211. The 

15 electronic variable magnification control circuit 212 
also controls the method of reading out the Image 
sensing data from the memory 1 (202), as needed. The 
processing In the zoom control circuit 211 and 
electronic variable magnification control circuit 212 

20 will be described later In detail. 

A maximum magnification ratio selection value by 
the maxlmiim magnification ratio setting circuit 109 
shown In Fig. 1 Is Input to a maximum magnification 
ratio selection Input terminal 214 (to be referred to 

25 as a terminal 214 hereinafter) . The maximum 

magnification ratio selection value Input to the 
terminal 214 Is processed by the zoom control circuit 
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211 In accordance with the mode corresponding to the 
selection value. A zoom magnification ratio indication 
output terminal 215 (to be referred to as a terminal 
215 hereinafter) is connected to the input teirminal of 
5 the zoom magnification ratio indication circuit 110 to 
output zoom magnification ratio indication data to it. 
The optical zoom control circuit 216 executes optical 
zoom by controlling the lens optical system 101 in 
accordance with an instruction from the zoom control 

10 circuit 211. An optical zoom output terminal 217 (to 
be referred to as a terminal 217 hereinafter) is 
connected to the lens optical system 101 to output 
optical zoom data, which is output from the optical 
zoom control circuit 216 to control the optical zoom 

15 processing, to the lens optical system 101. 

With the above arrangement , the camera signal 
processing circuit 104 converts image sensing data into 
still image data in the still image format in 
accordance with the first recording mode, converts 

20 image sensing data into moving image data in the moving 
image format in accordance with the second recording 
mode, or executes procesfsing related to optical zoom or 
electrical zoom. 

The arrangement of the reduction processing 

25 circuit (a first electronic variable magnification 

means serving as a first signal processing means) 205 
shown in Fig, 2 will be described next. Fig. 3 is a 
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block diagram showing the schema:tlc arrangement of the 
reduction processing circuit 205 shown In Fig. 2. 
Referring to Fig. 3, an Input terminal 301 Is connected 
to the electronic variable magnification control 
5 circuit 212 shown In Fig. 2 to receive electronic 
variable magnification control data from It. A 
reduction control circuit 302 specifies the variable 
magnification ratio from the electronic variable 
magnification control data which corresponds to the 

10 mode and Is Input from the electronic variable 

magnification control circuit 212 through the Input 
terminal 301. The reduction control circuit 302 
controls an LPF (Low-Pass Filter) coefficient setting 
circuit 304 (to be described later) In accordance with 

15 the variable magnification ratio. The reduction 
control circuit 302 also controls a down-sampling 
circuit 306 (to be described later) In accordance with 
the variable magnification ratio. 

An Input terminal 303 Is connected to the Image 

20 sensing signal processing circuit 203 shown In Fig. 2 
to receive Image data from It . A variable spatial LPF 
(Low-Pass Filter) 305 limiting the band of the Image 
data Input from the Image sensing signal processing 
circuit 203 through the Input terminal 303 to prevent 

25 aliasing (aliasing of a high-frequency component) due 
to reduction processing. The LPF coefficient setting 
circuit 304 sets an LPF coefficient corresponding to 

- 32 - 



CFM03494/P204-0054 

the reduction ratio in the variable spatial LPF 305 
under the control of the reduction control circuit 302. 

An example of a method of setting an LPF 
coefficient corresponding to a reduction ratio will be 
5 described. Fig. 4 is a graph showing a setting example 
of a variable spatial LPF in the horizontal direction 
corresponding to the reduction ratio. Generally, 
aliasing can be prevented by band limit up to a 
frequency equivalent to the Nyquist frequency after 

10 reduction. For this reason, a horizontal spatial 

frequency to be band- limited is defined in accordance 
with the reduction ratio, thereby setting the LPF 
characteristic. More specifically, as shown in Fig. 4, 
the LPF characteristic is set such that the lower the 

15 reduction ratio becomes, the smaller the band of the 
horizontal spatial frequency becomes . 

The down- sampling circuit 306 executes reduction 
processing for the image data band-limited by the 
variable spatial LPF 305 on the basis of the variable 

20 magnification ratio from the reduction control circuit 
302. An output terminal 307 outputs the reduced image 
data output from the down-sampling circuit 306. The 
output terminal 307 is connected to the input side of 
the recording signal processing circuit 105. As the 

25 digital image data reduction method in the reduction 

processing circuit 205, a general reduction method such 
as a reduction method by Bi -Cubic interpolation using a 
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secondary re- sampling filter can suitably be used. 

The arrangement of the enlargement processing 
circuit (a second electronic variable magnification 
means serving as a second signal processing means) 206 
5 shown in Fig. 2 will be described next. Fig. 5 is a 
block diagram showing the schematic arrangement of the 
enlargement processing circuit 206 shown in Fig. 2. An 
input terminal 501 is connected to the electronic 
variable magnification control circuit 212 shown in 

10 Fig. 2 to receive electronic variable magnification 

control data from it. An enlargement control circuit 
502 specifies the enlargement ratio from the electronic 
variable magnification control data input from the 
electronic variable magnification control circuit 212 

15 shown in Fig. 2 through the input terminal 501. The 

enlargement control circuit 502 controls an up- sampling 
circuit 504 and a correction coefficient setting 
circuit 505 (both will be described later) in 
accordance with the enlargement ratio. 

20 An input terminal 503 is connected to the image 

sensing signal processing circuit 203 shown in Fig. 2 
to receive image data from it. The up-sampling circuit 
504 executes enlargement processing for the image data 
input from the input terminal 503 in accordance with 

25 the enlargement ratio from the enlargement control 
circuit 502. As the digital image data enlargement 
method in the enlargement processing circuit 206, a 
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general enlargement method such as an enlargement 
method by B±-Cubic interpolation using a 2nd-order 
re-sampling filter can suitably be used. 

The correction coefficient setting circuit 505 
5 sets a correction coefficient to be used by an aperture 
correction circuit 506 (to be described later) in 
accordance with the enlargement ratio from the 
enlargement control circuit 502 . The aperture 
correction circuit 506 executes aperture correction 

10 processing for correcting the degradation in sharpness 
of the image due to enlargement processing. As a 
detailed example of aperture correction processing, an 
edge enhancement signal is obtained by separating the 
edge component of the image, multiplied by a 

15 predetermined gain, and added to the original image. 

As described above, the enlargement control circuit 502 
controls the up-seunpling circuit 504 and also controls 
the correction coefficient setting circuit 505 in 
accordance with the variable magnification ratio to 

20 control the characteristic of the aperture correction 
circuit 506 . 

The relationship between aperture correction 
processing and an enlargement ratio will be described. 
Fig. 6 is a graph showing a control excunple in which 

25 the gain of an edge enhancement signal in aperture 

correction processing is increased in proportion to the 
enlargement ratio. The correction coefficient setting 
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Circuit 505 sets, for the aperture correction circuit 
506, a correction coefficient whiqh increases the gain 
of an edge enhancement signal in proportion to the 
enlargement ratio, as shown in Fig. 6. That is, the 
5 enlargement control circuit 502 controls the correction 
coefficient setting circuit 505 to cause it to set a 
correction coefficient proportional to the enlargement 
ratio . 

The zoom operation in the second recording mode 

10 (moving image mode) in the digital video camera shown 
in Fig. 1 will be described next. In the following 
description, the photographing range of an object (the 
range of an object in image data to be recorded in the 
recording medium 106) is the view angle. 

15 Fig. 9 is a view showing the outline of an image 

magnification ratio and the zoom operation in the 
second recording mode in the digital video camera shown 
in Fig. 1. Referring to Fig. 9, a frame 901 indicates 
a view angle when optical zoom is in the maximum 

20 telephoto state. In electrical zoom according to this 
embodiment, the image sensing element 102 and memory 1 
(202) process image sensing data having an image size 
corresponding to the frame 901. More specifically, the 
charge read range (scanning range) on the surface 

25 (image sensing surface) of the effective pixel region 

in the image sensing element 102 is the range indicated 
by the frame 901. 
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A frame 902 Indicates a view angle at which 
variable magnification processing at a magnification 
ratio of X i can be executed in the second recording 
mode. The frame 902 Indicates an image area 
5 corresponding to the recording image size, which is 

extracted, in the second recording mode, from the image 
sensing data within the image sensing range indicated 
by the frame 901. A frame 903 indicates a view angle 
larger than the frame 901 when optical zoom is In the 

10 maximum wide-angle state. A frame 904 indicates a view 
angle in enlargement processing as the second signal 
processing by electrical zoom. The frame 904 indicates 
an image area to be enlarged in the image sensing data 
having the view angle Indicated by the frame 901. As 

15 indicated by the frames 901 to 904, the view angle 
Increases toward the wide -angle side and decreases 
toward the telephoto side. In other words, the image 
becomes smaller toward the wide-angle side and larger 
toward the telephoto side. 

20 A recording image 905 in the wide-angle state is 

the image of moving image data which is recorded in the 
recording medium 106 at the view angle indicated by the 
frame 903. A recording image 906 in the maximum 
telephoto state of optical zoom is the image of moving 

25 image data which is recorded in the recording medium 
106 at the view angle Indicated by the frame 901. A 
recording image 907 when the image sensing data is 
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processed at a magnification ratio of Xi is the image 
of moving image data which is recorded in the recording 
medium 106 at the view angle indicated by the frame 
902. A recording image 908 in enlargement processing 
5 by electrical zoom is the image of moving image data 
which is recorded in the recording medium 106 at the 
view angle indicated by the frame 904. The sizes of 
the recording images 905 to 908 correspond to the image 
sizes of the moving image data, which are image sizes 

10 defined by the DV format. As indicated by the 

recording images 905 to 908, on the basis of image 
sensing data within the processing range which changes 
in accordance with a change in view angle , moving image 
data having an image size defined by a predetermined 

15 format is generated and recorded on the recording 
medium 106. 

In the digital video camera, the above -described 
change in view angle from the frame 903 to the frame 
901 is implemented by controlling the lens optical 

20 system 101. This view angle change region corresponds 
to an optical zoom region 910 shown in Fig. 9. The 
above -described change in view angle from the frame 901 
to the frame 902 is implemented by electrical zoom 
processing (reduction processing) by the camera signal 

25 processing circuit 104. This view angle change region 
corresponds to an electrical zoom 1 region 911 shown in 
Fig. 9. The above -described change in view angle from 
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the frame 902 to the frame 904 Is Implemented by 
electrical zoom processing (enlargement processing as 
second signal processing) by the camera signal 
processing circuit 104. This view angle change region 
5 corresponds to an electrical zoom 2 region 912 shown in 
Fig. 9. 

As shown even in Fig. 8, in the second recording 
mode of the digital video camera according to this 
embodiment, the image size of image sensing data is 

10 reduced, and the image data is recorded as moving image 
data. Hence, electronic variable magnification 
processing (reduction processing as first signal 
processing) is executed even in the optical zoom region 
910. More specifically, from the maximum telephoto 

15 state to the maximum wide-angle state of optical zoom 
in the optical zoom region 910, optical zooming by the 
lens optical system 101 is performed under a 
predetermined electronic magnification (reduction) 
ratio. The image size of the recording image 907 is 

20 the same as that extracted from the image sensing data, 
as indicated by the frame 902. In this case, since the 
extracted size equals the recording size, electronic 
variable magnification ratio = 1 (Xi), 

The variable magnification processing circuit 207 

25 detects that the electronic variable magnification 
(reduction) ratio has reached the limit. When 
electronic variable magnification ratio = 1 , this 
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circuit detects that the electronic variable 
magnification (reduction) ratio has reached the limit. 
For example, this corresponds to a case wherein an 
image having 320 X 240 pixels should be generated, and 
5 image sensing data corresponding to 320 X 240 pixels 
is acquired. The circuit miay be designed to detect 
that the electronic variable magnification (reduction) 
ratio has reached the limit when the electronic 
variable magnification ratio has reached a 

10 predetermined value approximate to electronic variable 
magnification ratio = 1. 

In this embodiment, for the descriptive 
convenience, electronic variable magnification ratio = 
1 applies to both the horizontal and vertical 

15 directions. However, the present invention is not 
limited to this. For example, when the second 
recording mode is a DV format recording mode, sampling 
is done on the basis of a moving image data standard 
except a square matrix, and the image sensing element 

20 102 has a square matrix, processing at a magnification 
ratio of X i ±s executed in one of the horizontal and 
vertical directions. For the other direction, 
adjustment by electronic variable magnification 
processing is necessary Xi) 

25 As indicated by the electrical zoom 1 region 911, 

from the frame 901 in the maximum telephoto state of 
optical zoom to the frame 902 corresponding to 
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extraction at a magnification ratio of Xi, the 
electrical zoom effect Is obtained by changing the 
extraction image size in accordance with electronic 
variable magnification (reduction) processing such that 
5 a predetermined recording image size can be obtained. 
When the view angle changes from the frame 902 to the 
frame 904, it means that extraction image size is 
smaller than recording image size. In this case, 
enlargement processing is executed. That is, an 

10 electronic variable magnification ratio is larger than 
1. More specifically, from the frame 902 corresponding 
to extraction at a magnification ratio of X i to the 
frame 904 corresponding to the upper limit (maximum 
magnification ratio) of electrical zoom, the electrical 

15 zoom effect is obtained by changing the extraction 
image size in accordance with electronic variable 
magnification (enlargement) processing for a 
predetermined recording image size. 

Processing of a maximum magnification ratio 

20 selection value which Is Input from the maximum 

magnification ratio setting circuit 109 shown in Fig. 1 
to the terminal 214 shown in Fig. 2 will be described 
next. The zoom magnification ratio control circuit 211 
changes the control method of the optical zoom control 

25 circuit 216 and electronic variable magnification 
control circuit 212 In a mode corresponding to the 
metximum magnification ratio selection value Input to 
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the terminal 214, thereby changing the zoom control 
range by zoom operation key Input. A setting example 
of the maximum magnification ratio selection value will 
be described here by using a detailed example of the 
5 maximum magnification ratio selection switch 111. 
Fig. 13 is a view showing a detailed example of the 
maximum magnification ratio selection switch 111. As 
shown in Fig. 13, the maximum magnification ratio 
selection switch 111 is a maximum magnification ratio 

10 setting menu by, e.g., a GUI (Graphical User Interface) 
displayed on the viewfinder 114 of the digital video 
camera. This can be implemented by mounting, in the 
digital video camera, a program which implements the 
above -described GUI and a CPU which executes the 

15 program. 

Referring to Fig. 13, a setting menu item display 
1301 contains setting menu items such as "camera shake 
correction" , "electrical zoom" , and "white balance" . 
An electrical zoom setting item 1302 is a list of 

20 setting items related to the electrical zoom function 
(in this exsunple, the maximum variable magnification 
ratio), including three items "OFF", "X2" and "X8". 
The electrical zoom setting item 1302 is displayed by 
selecting "electrical zoom" in the setting menu item 

25 display 1301. Referring to Fig. 13, "electrical zoom" 
in the setting menu item display 1301 is selected, as 
indicated by an arrow 1303. Referring to Fig. 13, "X 



- 42 - 



CFM03494/P204-0054 

2" as the second mode in the electrical zoom setting 
item 1302 is selected, as indicated by an arrow 1304. 

The operator of the digital video camera selects 
the "electrical zoom" menu, i.e., the maximum 
5 magnification ratio selection item, from the setting 
menu item display 1301 by moving the arrow 1303. 

With this operation, a mode is set. This 
operation can be expressed by the flows shown in 
Figs. 14, 15, and 16. As shown in Fig. 14, first, a 

10 magnification ratio is set (a mode is set), as 

described above (step SI). Accordingly, the electrical 
zoom setting item 1302 is displayed. After that, the 
camera signal processing circuit 104 issues an 
instruction to set the magnification ratio to the 

15 wide-angle side (initialization) (step S2). 

When the item "OFF" in the electrical zoom 
setting item 1302 is selected, only the optical zoom 
region 910 shown in Fig. 9 is used. That is, 
photographing can be executed from the recording image 

20 905 to the recording image 906 in Fig. 9. 

When the item "X2" as the second mode is 
selected (NO in step S3 and step S4), the optical zoom 
region 910 and electrical zoom 1 region (reduction mode 
region) 911 in Fig. 9 are used. In this case, 

25 photographing can be executed from the recording image 
905 to the recording image 907. As shown in Fig. 15, 
when it is detected that movement from the wide-angle 
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side to the telephoto side Is selected by the zoom 
operation key 112 (step S5), the variable magnification 
processing circuit 204 executes reduction processing as 
first signal processing under the control of the zoom 
5 control circuit (step S6). If It Is detected that the 
Increase In Image magnification ratio by the reduction 
processing has reached the limit (YES In step S7), the 
above -described enlargement processing Is Inhibited 
(step S9) even when It Is continuously detected that 

10 movement from the wide-angle side to the telephoto side 
Is still selected by the zoom operation key 112 (YES In 
step S8)* If It Is not detected that the Increase In 
Image magnification ratio by the reduction processing 
In step S6 has reached the limit (NO In step S7), the 

15 flow returns to step S5 to detect the operation 

(telephoto or wide-angle) of the zoom operation key 
112. If YES In step S7, and It Is not detected that 
movement from the wide-angle side to the telephoto side 
Is still selected by the zoom operation key 112 (NO In 

20 step S8), the flow returns to step S5. 

' When the Item "Xs" as the first mode Is selected 
(YES In step S3), the optical zoom region 910, 
electrical zoom 1 region (reduction mode region as the 
first mode) 911, and electrical zoom 2 region 

25 (enlargement mode region as the second mode) 912 In 
Fig. 9 are used. In this case, photographing can be 
executed from the recording Image 905 to the recording 
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Image 908. As shovm In Fig. 14, when it is detected 
that movement from the wide-angle side to the telephoto 
side is selected by the zoom operation key 112 (step 
S13), the variable magnification processing circuit 204 
5 executes reduction processing as first signal 

processing under the control of the zoom control 
circuit (step S14) . If it is detected that the 
increase in image magnification ratio by the reduction 
processing has reached the limit (YES in step S15), and 

10 it is detected that movement from the wide-angle side 
to the telephoto side is still selected by the zoom 
operation key 112 (YES in step S16), the 
above -described enlargement processing is executed as 
second signal processing shown in Fig. 16 (step S17). 

15 If it is not detected that the increase in image 

magnification ratio by the reduction processing in step 
S14 has reached the limit (NO in step S15), the flow 
returns to step S13 to detect the operation (telephoto 
or wide-angle) of the zoom operation key 112. If YES 

20 in step S15, and it is not detected that movement from 
the wide-angle side to the telephoto side is still 
selected by the zoom operation key 112 (NO in step 
S16), the flow returns to step S13. 

After processing in step S17 in Fig. 16, the 

25 telephoto state or wide-angle state is detected, and 

the second signal processing is repeated (steps S18 and 
S19, NO in step S20, and NO in step S21). When the 
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magnification ratio returns to the limit value of the 
Increase In magnification ratio by the above -described 
reduction processing (YES in step S20), the flow 
returns to step S13 In Fig. 14 to start the flow of 
5 first signal processing. Note that returning the 

magnification ratio to the limit value of the Increase 
in magnification ratio by the reduction processing 
means that the magnification ratio in the second signal 
processing reaches, by reduction processing, the limit 

10 on the first signal processing side (the side of the 
electrical zoom 1 region 911 in Fig. 9). 

On the other hand, assume that the magnification 
ratio does not return to the limit value of the 
Increase in magnification ratio by the above -described 

15 reduction processing (NO in step S20), it is 

continuously detected In step S18 that movement from 
the wide-angle side to the telephoto side is still 
selected, and the magnification ratio has reached the 
limit of the enlargement processing as the second 

20 signal processing (YES in step S21). In this case, 
even when it is continuously detected that movement 
from the wide-angle side to the telephoto side is 
selected by the zoom operation key 112 (YES in step 
S22), the above -described enlargement processing as the 

25 second signal processing is inhibited (step S23). If 
It is continuously detected In step S18 that movement 
from the wide-angle side to the telephoto side is 
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selected, and the magnification ratio has not reached 
the limit of the enlargement processing as the second 
signal processing (NO in step S21), the flow returns to 
step S18 to detect the operation (telephoto or 
5 wide-angle) of the zoom operation key 112. If YES in 
step S21, and it is not detected that movement from the 
wide-angle side to the telephoto side is selected by 
the zoom operation key 112 (NO in step S22), the flow 
returns to step S18. 

10 As described above, by setting the maximum 

magnification ratio selection switch 111, the zoom 
magnification ratio "X2" until electronic variable 
magnification is executed as the reduction operation 
under the control of the zoom control circuit 211 can 

15 be selected as the maximum variable magnification ratio 
so that the second mode can be selected and set. 
Accordingly, the operator can select and set a new zoom 
mode in which electronic enlargement processing causes 
no degradation in image quality, and the zoom 

20 magnification ratio can be set higher than in only 
optical zoom. In addition, the electronic variable 
magnification control circuit 212 controls the 
extraction area size in reading out image sensing data 
from the variable magnification processing circuit 204 

25 and memory 1 (202) under the control of the zoom 

control circuit 211, thereby executing the electrical 
zoom operation for enlargement /reduction, as described 
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above . 

The variable magnification processing selection 
circuit 207 selects, under the control of the 
electronic variable magnification control circuit 212, 
5 the output from the reduction processing circuit 205 
for a variable magnification ratio in the first signal 
processing in which electronic variable magnification 
is executed as reduction processing. The variable 
magnification processing selection circuit 207 selects 

10 the output from the enlargement processing circuit 206 
for a variable magnification ratio in the second signal 
processing in which electronic variable magnification 
is executed as enlargement processing. For a variable 
magnification ratio in electronic variable 

15 magnification at a magnification ratio of Xi (e.g., 
when an image having 320 X 240 pixels should be 
generated and recorded, and image sensing data 
corresponding to 320 X 240 pixels is acquired) , the 
variable magnification processing selection circuit 207 

20 selects the output from the image sensing signal 

processing circuit 203 without intervening variable 
magnification processing. That is, the output from the 
reduction processing circuit 205 is selected in the 
optical zoom region 910 and electrical zoom 1 region 

25 911. The output from the image sensing signal 

processing circuit 203 is selected in extraction at a 
magnification ratio of Xi. The output from the 
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enlargement processing circuit 206 Is selected In the 
electrical zoom 2 region 912. 

When the sampling matrix of the image sensing 
element 102 is different from that in the recording 
5 mode, as described above, processing at a magnification 
ratio of X i ±s executed in one of the horizontal and 
vertical directions. For the other direction, 
electronic variable magnification ratio =^ 1. In this 
case, even in the processing at a magnification ratio 

10 of X 1 , horizontal or vertical electronic variable 
magnification processing must be executed. In 
accordance with the electronic variable magnification 
ratio, the output from the reduction processing circuit 
205 or enlargement processing circuit 206 is selected. 

15 The schematic arrangement of a variable 

magnification processing circuit 204a having an 
arrangement different from that of the variable 
magnification processing circuit 204 shown in Figs. 2, 
3, and 5 will be described next. Fig. 7 is a block 

20 diagram showing the schematic arrangement of the 

variable magnification processing circuit 204a which 
has an arrangement different from that of the variable 
magnification processing circuit 204 shown in Figs. 2, 
3, and 5. That is, the variable magnification 

25 processing circuit 204a shown in Fig. 7 may replace the 
variable magnification processing circuit 204 shown in 
Fig. 2. The variable magnification processing circuit 
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204a shown in Fig. 7 uses the same re-sampling filter 
algorithm for enlargement and reduction. The 
enlargement and reduction are switched only by 
controlling the variable magnification coefficient so 
5 that the circuit has a simpler arrangement than that of 
the variable magnification processing circuit 204 shown 
in Fig. 2. 

Referring to Fig. 7, an input terminal 701 is 
connected to the electronic variable magnification 

10 control circuit 212 shown in Fig. 2 to receive 

electronic variable magnification control data from it. 
A variable magnification control circuit 702 specifies 
the variable magnification ratio from the electronic 
variable magnification control data input from the 

15 electronic variable magnification control circuit 212 
through the input terminal 701 and controls a 
re-sampling filter 704 (to be described later) in 
accordance with the variable magnification ratio. An 
input terminal 703 is connected to the image sensing 

20 signal processing circuit 203 shown in Fig. 2 to 

receive image data from it. The re-sampling filter 704 
enlarges or reduces the image data input from the input 
terminal 703 in accordance with the variable 
magnification ratio input from the variable 

25 magnification control circuit 702. 

An operation for causing the zoom control circuit 
211 shown in Fig. 2 to supply a zoom magnification 
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ratio indication output corresponding to the zoom 
operation key input to the zoom magnification ratio 
indication circuit 110 shown in Fig. 1 and causing the 
viewfinder 114 to display the zoom magnification ratio, 
5 and display examples will be described next. Fig. 10 
is a view showing an example of zoom magnification 
ratio indication on the viewfinder 114 in which a 
photographing image is confirmed. Referring to 
Fig. 10, a zoom magnification ratio indicator 1001 

10 includes an indicator 1002 which indicates the zoom 

magnification ratio during photographing by the digital 
video camera in a scale having the maximum wide-angle 
state and the maximum telephoto state at two ends. "W" 
represents the maximum wide-angle state, and "T" 

15 represents the maximum telephoto state in Fig. 10. The 
indicator 1002 moves on the scale as the optical zoom 
magnification ratio or electrical zoom magnification 
ratio controlled by the zoom control circuit 211 
changes in accordance with the zoom operation key 

20 input . 

Display of boundary lines between variable 
magnification ratios on the zoom magnification ratio 
indicator 1001 will be described next. Figs. IIA to 
lie are views showing display examples of boundary 
25 lines between variable magnification ratios on the zoom 
magnification ratio indicator 1001. Fig. IIA shows a 
display example of the zoom magnification ratio 
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Indicator 1001 when zooming can be executed In the 
optical zoom region 910, electrical zoom 1 region 911, 
and electrical zoom 2 region 912 shown In Fig. 9. At 
this time, setting by the maximum magnification ratio 
5 selection switch 111 corresponds to "X8" In the 

electrical zoom setting Item 1302 shown In Fig. 13. 
Referring to Fig. IIA, an Indicator 1101 Indicates the 
current zoom magnification ratio. A boundary line 1102 
Indicates the upper limit of optical zoom (the maximum 

10 wide-angle state In the optical zoom region 910 In 
Fig. 9). A boundary line 1103 Indicates the upper 
limit of electrical zoom 1 (the boundary between the 
electrical zoom 1 region 911 and the electrical zoom 2 
region 912 in Fig. 9). The maximum telephoto state 

15 represented by "T" corresponds to the recording image 

908 in Fig. 9 when the maximum magnification ratio is " 
X8". 

Fig. IIB shows a display example of the zoom 
magnification ratio indicator 1001 when zooming can be 

20 executed in the optical zoom region 910 and electrical 
zoom 1 region 911 shown in Fig. 9. At this time, 
setting by the maximum magnification ratio selection 
switch 111 corresponds to •'X2" in the electrical zoom 
setting item 1302 shown in Fig. 13. The maximum 

25 telephoto state represented by "T" corresponds to the 
recording image 907 in Fig. 9 when the mcuclmum 
magnification ratio is "X2". 
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Fig. lie shows a display example of the zoom 
magnification ratio Indicator 1001 when zooming can be 
executed in the optical zoom region 910 shown in 
Fig. 9. At this time, setting by the maximtmi 
magnification ratio selection switch 111 corresponds to 
"OFF" in the electrical zoom setting item 1302 shown in 
Fig. 13. The maximum telephoto state represented by 
"T" corresponds to the recording image 906 (Fig. 9) in 
the maximtim telephoto state of optical zoom. 

Examples of the zoom magnification ratio 
indicator 1001 different from Figs. IIA to IIC will be 
described next. Figs. 12A to 12C are views showing 
examples of the zoom magnification ratio indicator 1001 
different from Figs. IIA to IIC. The zoom 
magnification ratio indicator 1001 shown in Figs. IIA 
to lie can be scaled (i.e., the zoom magnification 
ratio indicator 1001 has a predetermined length) . 
However, Figs. 12A to 12C show display examples in 
which the scale of the zoom magnification ratio 
indicator 1001 Is fixed (i.e., the length of the zoom 
magnification ratio indicator 1001 changes). 

Fig. 12A shows a display example of the zoom 
magnification ratio indicator 1001 when zooming can be 
executed in the optical zoom region 910, electrical 
zoom 1 region 911, and electrical zoom 2 region 912 
shown in Fig. 9. Referring to Fig. 12A, an Indicator 
1201 Indicates the current zoom magnification ratio. A 
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boundazry line 1202 Indicates the upper limit of optical 
zoom (the maximum wide-angle state in the optical zoom 
region 910 in Fig. 9). A boundary line 1203 indicates 
the upper limit of electrical zoom 1 (the boundary 
5 between the electrical zoom 1 region 911 and the 

electrical zoom 2 region 912 in Fig. 9). As described 
above. Fig. 12A corresponds to Fig. IIA described 
above, and the display form and display contents are 
the same. 

10 Fig. 12B shows a display excimple of the zoom 

magnification ratio indicator 1001 when zooming can be 
executed in the optical zoom region 910 and electrical 
zoom 1 region 911 shown in Fig. 9. The zoom 
magnification ratio indicator 1001 shown in Fig. 12B is 

15 shorter than that in Fig. 12A (even that in Fig. IIB) 
by a length corresponding to the electrical zoom 2 
region 912. 

Fig. 12C shows a display example of the zoom 
magnification ratio indicator 1001 when zooming can be 

20 executed in the optical zoom region 910 shown in 

Fig. 9. The zoom magnification ratio indicator 1001 
shown in Fig. 12C is shorter than that in Fig. 12A 
(even that in Fig. IIC) by a length corresponding to 
the electrical zoom 1 region 911 and electrical zoom 2 

25 region 912. 

As described above, the zoom magnification ratio 
indicator 1001 displayed on the viewfinder 114 can have 
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an arbitrary shape. The zoom magnification ratio may 
also be indicated by a numerical value. When a 
boundary line is shown as described above, the user can 
be notified of the start of electrical zoom (reduction 
5 processing), the start of electrical zoom (enlargement 
processing) , or the maximum magnification ratio set 
state . 

As the second embodiment of the present 
invention, a digital video camera (image recording 

10 apparatus) which also has a photographing mode in which 
the zoom operation is performed only by an optical zoom 
means without executing electronic variable 
magnification processing will be described next. 

Fig. 17 is a block diagram showing the schematic 

15 arrangement of a digital video camera according to the 
second embodiment of the present invention- The same 
reference numerals as in the digital video camera shown 
in Fig. 1 denote constituent components having the seune 
functions in the digital video Ccimera shown in Fig. 17, 

20 and a description thereof will be omitted. The digital 
video camera shown in Fig. 17 is different from that 
shown in Fig. 1 in a X i magnification fixing switch 
1413 and a ccimera signal processing circuit 104a. The 
different parts will mainly be described. 

25 Referring to Fig. 17, the Xi magnification 

fixing switch 1413 sets a photographing mode (second 
photographing mode) in which the electronic variable 
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magnification ratio is fixed at Xi, and only optical 
zoom Is used or a photographing mode (first 
photographing mode) in which electronic variable 
magnification is used. More specifically, when the Xi 
5 magnification fixing switch 1413 is set to the first 
photographing mode, the digital video camera of this 
embodiment executes the same photographing operation as 
that of the digital video camera shown in Fig . 1 . When 
the Xi magnification fixing switch 1413 is set to the 

10 second photographing mode, the digital video ceunera of 
this embodiment executes a photographing operation 
unique to this embodiment. The photographing operation 
unique to this embodiment will be described later. 

Vnien the Xi magnification fixing switch 1413 is 

15 set to the first photographing mode, the camera signal 
processing circuit 104a has the same function as that 
of the camera signal processing circuit 104 shown in 
Fig. 1 and executes various processing operations for 
converting image sensing data supplied from an A/D 

20 circuit 103 into image data, and a detailed description 
thereof will be omitted. When the Xi magnification 
fixing switch 1413 is set to the second photographing 
mode, the camera signal processing circuit 104a 
executes zoom processing using only optical zoom, which 

25 is unique to this embodiment. In either photographing 
mode, the camera signal processing circuit 104a 
controls the optical zoom driving mechanism of a lens 
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optical system 101 to execute optical zooming. The 
digital video camera shown in Fig. 17 comprises not 
only the constituent components shown in Fig. 17 but 
also constituent components prepared in common digital 
5 video cameras, including a system controller, a 

recording medium driving circuit, and a user interface 
circuit. However, these constituent components are 
unnecessary for the description of the embodiment of 
the present invention and therefore are not 

10 illustrated. 

The camera signal processing circuit 104a shown 
in Fig. 17 will be described next in detail. Fig. 18 
is a block diagram for explaining details of the camera 
signal processing circuit 104a shown in Fig. 17. As 

15 shown in Fig. 18, the camera signal processing circuit 
104a has the same arrangement as that of the camera 
signal processing circuit 104 shown in Fig. 2 except a 
Xi magnification fixing input terminal 1516 (to be 
referred to as an input 1516 hereinafter) and a zoom 

20 control circuit 211a, and a description of components 

having the same reference numerals as in Fig. 2 will be 
omitted. In accordance with setting of the Xi 
magnification fixing switch 1413 input from the 
terminal 1516, the camera signal processing circuit 

25 104a implements the second photographing mode in which 
the electronic variable magnification ratio is fixed at 
Xi, and only optical zoom is used. 
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More specifically, in the second photographing 
mode, the zoom control circuit 211a in the camera 
signal processing circuit 104a instructs an electronic 
variable magnification control circuit 212 to execute 
5 variable magnification processing at a magnification 
ratio of X 1 and also instructs an optical zoom control 
circuit 216 to execute zoom processing corresponding to 
the operation of the zoom operation key. Accordingly, 
the photographing mode in which the electronic variable 

10 magnification ratio is fixed at Xi, and only optical 
zoom is used can be implemented. At this time, a 
variable magnification processing selection circuit 207 
selects the output from an image sensing signal 
processing circuit 203, which is processed on the basis 

15 of image sensing data extracted from a memory 1 (202) 
at a magnification ratio of Xi. As described above, 
when the sampling matrix of an image sensing element 
102 is different from that of the recording image 
format, as described above, processing at a 

20 magnification ratio of Xi is executed in one of the 
horizontal and vertical directions. For the other 
direction, electronic variable magnification processing 
is executed. In this case, even in the processing at. a 
magnification ratio of Xi, horizontal or vertical 

25 electronic variable magnification processing must be 
executed. In accordance with the electronic variable 
magnification ratio, the output from a reduction 
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processing circuit 205 or enlargement processing 
circuit 206 Is selected. The circuit and variable 
magnification ratio are fixed once they are selected by 
the varliable magnification processing selection circuit 
5 207. 

Zoom processing In the second photographing mode 
will be described here . 

Fig. 19 Is a view showing the outline of zoom 
processing In the second photographing mode. A frame 

10 1901 Indicates a view angle which changes In accordance 
with the magnification ratio of optical zoom. The 
Image sensing element 102 and memory 1 (202) process 
Image sensing data having an Image size corresponding 
to the frame 1601. The Image sensing signal processing 

15 circuit 203 extracts an Image size corresponding to a 
frame 1603 from Image data held In the memory 1 (202) 
and executes signal processing. A variable 
magnification processing circuit 204 outputs the Image 
data output from the Image sensing signal processing 

20 circuit 203 without executing electronic variable 

magnification processing. With this arrangement, in 
the second photographing mode, the digital video camera 
executes the zoom operation by using only optical zoom. 
The digital video camera obtains image data 

25 corresponding to a recording image 1602 in the maximum 
wide-angle state or a recording image 1606 in the 
maximum telephoto state. A recording image 1604 is an 
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Image during zooming. 

In the above -described second photographing mode, 
the view angle is different from that in optical zoom 
with reduction processing described in the first 
5 embodiment. However, image recording without any 
change in image quality due to reduction can be 
implemented. When the sampling matrix of the image 
sensing element 102 is different from that of the 
recording format, as described above, processing at a 

10 magnification ratio of X i is executed in one of the 
horizontal and vertical directions . For the other 
direction, electronic variable magnification processing 
is executed. Even in this case, since no variable 
magnification processing is executed in the direction 

15 of magnification ratio of Xi, image recording without 
any degradation in image quality in the direction of 
magnification ratio of X i can be implemented. 

As the third embodiment of the present invention, 
a digital video camera which executes a zoom operation 

20 without using an optical zoom means will be described 
next . 

Fig. 20 is a block diagram showing the schematic 
arrangement of a digital video camera according to the 
third embodiment of the present invention. The same 
25 reference numerals as in the digital video camera shown 
in Fig. 1 denote constituent components having the same 
functions in the digital video camera shown in Fig. 20, 
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and a description thereof will be omitted. The digital 
video camera shown in Fig. 20 is different from that 
shown in Fig. 1 in a lens optical system 101a, camera 
signal processing circuit 104b, maximum magnification 
5 ratio setting circuit 109a, and maximum magnification 
ratio selection switch 111a. The different parts will 
mainly be described. 

The lens optical system 101a includes an optical 
lens which foarms an image of incident light on an image 

10 sensing element 102, an aperture, a focus controller, 
various kinds of optical filters, and a driving 
mechanism for them. The above -described optical 
mechanism in the lens optical system 101a of the 
digital video camera shown in Fig. 20 is a common 

15 mechanism, and a detailed description thereof will be 

omitted. In addition, the lens optical system 101a has 
no zoom function, unlike the lens optical system 101 
shown in Fig . 1 . 

The camera signal processing circuit 104b 

20 executes various processing operations for converting 
image sensing data supplied from an A/D circuit 103 
into image data. The processing executed by the camera 
signal processing circuit 104b will be described later 
in detail. The maximum magnification ratio setting 

25 circuit 109a sets the maximtmi magnification ratio in 
the zoom operation in accordance with setting of the 
maximum magnification ratio selection switch 111a. The 
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setting by the maximum magnification ratio setting 
circuit 109a will be described later In detail. The 
digital video camera shown in Fig. 20 comprises not 
only the constituent components shown in Fig. 20 but 
5 also constituent components prepared in common digital 
video ccuneras, including a system controller, a 
recording medium driving circuit, and a user interface 
circuit. However, these constituent components are 
unnecessary for the description of the embodiment of 
10 the present invention and therefore are not 
illustrated. 

The camera signal processing circuit 104b shown 
in Fig. 20 will be described next in detail. Fig. 21 
is a block dlagreun for explaining details of the camera 

15 signal processing circuit 104b shown in Fig. 20. The 
same reference numerals as in the camera signal 
processing circuit 104 shown in Fig. 2 denote 
constituent components having the same functions in the 
camera signal processing circuit 104b shown in Fig. 21, 

20 and a description thereof will be omitted. The camera 
signal processing circuit 104b shown in Fig. 21 has an 
electrical zoom control circuit 1811, unlike the camera 
signal processing circuit 104 shown in Fig. 2. This 
different part will mainly be described. 

25 The electrical zoom control circuit 1811 decides 

the zoom magnification ratio in accordance with a zoom 
operation key input for a terminal 214 and controls the 
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Image extraction area size from a variable 
magnification processing circuit 204 and memory 1 
(202) • In the variable magnification processing 
circuit 204, an electrical zoom operation corresponding 
5 . to the zoom magnification ratio decided by the 

electrical zoom control circuit 1811 Is executed. The 
maximum magnification ratio selection value input to 
the terminal 214 is processed by the electrical zoom 
control circuit 1811. The electrical zoom control 

10 circuit 1811 outputs zoom magnification ratio 
indication data to a zoom magnification ratio 
indication circuit 110 shown in Fig. 20 through a 
terminal 215. Recording mode data which designates a 
first recording mode (still image recording mode) or a 

15 second recording mode (moving image mode) is input from 
a recording mode control circuit 108 shown in Fig. 1 to 
the electrical zoom control circuit 1811 through a 
terminal 210. This recording mode data is also input 
to an image sensing signal processing circuit 203, as 

20 described above. 

The operation of zoom processing In the digital 
video camera according to the third embodiment will be 
described here. 

Fig. 22 is a view showing the outline of the zoom 

25 processing operation In the digital video camera shown 
in Fig. 20. A frame 1901 indicates a view angle when 
electrical zoom is in the maximum wide-angle state. 
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The Image sensing element 102 and memory 1 (202) 
process Image sensing data having an Image size 
corresponding to the frame 1901, In this embodiment, 
in the second recording mode, the Image sensing data 
5 having the Image size corresponding to the frame 1901 
is reduced and recorded. Reference numeral 1902 
denotes a reduced recording image and its image size, 
which is obtained by reducing the image sensing data 
having the Image size corresponding to the frame 1901 

10 to an image size corresponding to the DV format while 
keeping the view angle unchanged and recorded in a 
recording medium 106. 

A frame 1903 indicates an extraction area at a 
magnification ratio of Xi, i.e., a partial image area 

15 having an image size equal to the recording image size 
in the image sensing data with the image size 
corresponding to the freune 1901. When the image 
sensing data is to be extracted in correspondence with 
the frame 1903 and subjected to signal processing, 

20 electronic variable magnification ratio = 1 (Xi) 

because the extraction size equals the recording size. 
When the sampling matrix of the image sensing element 
102 is different from that of the recording format, 
processing at a magnification ratio of X i is executed 

25 In one of the horizontal and vertical directions. For 
the other direction, electronic variable magnification 
processing is necessary. A recording image 1904 is 
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obtained by processing an Image area corresponding to 
the frame 1903. 

A frame 1905 indicates an extraction image area 
in the maximum telephoto state, i.e., a partial image 
5 area necessary for electrical zoom processing at the 
maximum variable magnification ratio in the image 
sensing data with the image size corresponding to the 
frame 1901. A recording image 1906 is obtained by 
processing an image area corresponding to the frame 
10 1905. 

A change in extraction image area from the 
above -de scribed frame 1901 to the frame 1903 is 
Implemented by electrical zoom processing (reduction 
processing) by the Ccunera signal processing circuit 

15 104b. The extraction image area change region is an 
electrical zoom 1 region 1907 shown in Fig. 22. A 
change in extraction image area from the 
above -de scribed frame 1903 to the frame 1905 is 
Implemented by electrical zoom processing (enlargement 

20 processing) by the camera signal processing circuit 

104b. This extraction image area change region is an 
electrical zoom 2 region 1908 shown in Fig. 22. 

More specifically, as indicated by the electrical 
zoom 1 region 1907, the electrical zoom effect is 

25 obtained by changing the extraction image size in 
accordance with electronic variable magnification 
(reduction) processing for a predetermined recording 
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Image size. When the extraction Image size changes 
from the frame 1903 to the frame 1905, extraction Image 
size < recording Image size. In this case, enlargement 
processing is executed at an electronic variable 
5 magnification ratio > 1. More specifically, from the 
frame 1903 corresponding to extraction at a 
magnification ratio of X i to the frame 1905 
corresponding to the upper limit (maximum magnification 
ratio) of electrical zoom, the electrical zoom effect 
10 is obtained by changing the extraction image size in 
accordance with electronic variable magnification 
(enlargement) processing for a predetermined recording 
image size. 

Processing of a maximum magnification ratio 
15 selection value which is input from the maximum 

magnification ratio setting circuit 109a shown in 
Fig. 20 to the terminal 214 shown in Fig. 21 will be 
described next. The electrical zoom control circuit 
1811 changes the control method of the variable 
20 magnification processing circuit 204 in correspondence 
with the maximum magnification ratio selection value 
input to the terminal 214, thereby changing the zoom 
control range by zoom operation key input . A setting 
example of the maximum magnification ratio selection 
25 value will be described here by using a detailed 

example of the maximum magnification ratio selection 
switch Ilia. Fig. 25 is a view showing a detailed 
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example of the maximum magnification ratio selection 
switch 111a. As shown In Fig. 25, the maximum 
magnification ratio selection switch 111a is a maximum 
magnification ratio setting menu by, e.g., a GUI 
5 displayed on a viewflnder 114 of the digital video 
camera. This can be implemented by mounting, in the 
digital video camera, a program which implements the 
above -described GUI and a CPU which executes the 
program. 

10 Referring to Fig. 25, a setting menu item display 

2201 contains setting menu items such as "csunera shake 
correction", "electrical zoom", and "white balance". 
An electrical zoom setting item 2202 is a list of 
setting items related to the electrical zoom function 

15 (in this example, the maximum variable magnification 
ratio). Including two items "X2" and "X8". The 
electrical zoom setting item 2202 is displayed by 
selecting "electrical zoom" in the setting menu item 
display 2201. Referring to Fig. 25, "electrical zoom" 

20 in the setting menu Item display 2201 is selected, as 
indicated by an arrow 2203. Referring to Fig. 25, "X 
8" in the electrical zoom setting Item 2202 is 
selected, as indicated by an arrow 2204. 

The operator of the digital video camera selects 

25 the "electrical zoom" menu, i.e., the maixlmum 

magnification ratio selection item, from the setting 
menu item display 2201 by moving the arrow 2203. With 
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this operation, the electrical zoom setting item 2202 
is displayed. 

When the item "X2" in the electrical zoom 
setting item 2202 is selected, the electrical zoom 1 
5 region (reduction mode region) 1907 in Fig. 22 is used. 
In this case, photographing can be executed from the 
recording image 1902 to the recording image 1904. When 
the item "Xs" is selected, the electrical zoom 1 
region (reduction mode region) 1907 and electrical zoom 

10 2 region (enlargement mode region) 1908 in Fig. 22 are 
used. In this case, photographing can be executed from 
the recording image 1902 to the recording image 1906. 

As described above, by setting the maximum 
magnification ratio selection switch 111a, the zoom 

15 magnification ratio "X2" until electronic variable 
magnification is executed as the reduction operation 
under the control of the electrical zoom control 
circuit 1811 can be selected as the maximum variable 
magnification ratio. Accordingly, the operator can 

20 select a zoom mode in which electronic enlargement 

processing causes no degradation in image quality. In 
addition, under the control of the electrical zoom 
control circuit 1811, the extraction image size of 
image sensing data held in the memory 1 (202) is 

25 changed, and the electrical zoom operation for 

enlargement /reduction corresponding to the variable 
magnification ratio is executed by the variable 
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magnification processing circuit 204. Extraction 
control from the memory 1 (202) and variable 
magnification processing by the variable magnification 
processing circuit 204 are the same as in the first 
5 embodiment, and a description thereof will be omitted. 
An operation for causing the electrical zoom 
control circuit 1811 shown in Fig. 21 to supply a zoom 
magnification ratio indication output corresponding to 
the zoom operation key input to the zoom magnification 

10 ratio indication circuit 110 shown in Fig. 20 and 
causing the viewflnder 114 to display the zoom 
magnification ratio, and display examples will be 
described next. Figs. 23A and 23B are views showing 
examples of zoom magnification ratio indication on the 

15 viewflnder 114 in which a photographing image is 

confirmed. Fig. 23A shows a display excunple of the 
zoom magnification ratio indicator when the maximum 
variable magnification ratio is the maximum value of 
electronic variable magnification, and zooming can be 

20 executed from the electrical zoom 1 region 1907 to the 
electrical zoom 2 region 1908 shown In Fig. 22. At 
this time, setting by the maximum magnification ratio 
selection switch 111 corresponds to "X8" in the 
electrical zoom setting item 2202 shown in Fig. 25. 

25 Referring to Fig. 23A, a zoom magnification ratio 
indicator 2000 Includes an indicator 2001 which 
indicates the zoom magnification ratio during 
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photographing by the digital video camera in a scale 
having the mciximiim wide-angle state and the maximum 
telephoto state at two ends. A boundary line 2002 
indicates the upper limit of electrical zoom 1 (the 
5 boundary between the electrical zoom 1 region 1907 and 
the electrical zoom 2 region 1908 in Fig. 22). The 
maximum telephoto state represented by "T" corresponds 
to the recording image 1906 in Fig. 22 when the maximum 
magnification ratio is "Xs". 

10 Fig. 23B shows a display example of the zoom 

magnification ratio indicator 2000 when zooming can be 
executed in the electrical zoom 1 region 1907 shown in 
Fig. 22. At this time, setting by the maximum 
magnification ratio selection switch 111a corresponds 

15 to "X2" in the electrical zoom setting item 2202 shown 
in Fig. 25. The maximum telephoto state represented by 
"T" corresponds to the recording image 1904 in Fig. 22 
when the maximum magnification ratio is "X2". 

Examples of the zoom magnification ratio 

20 indicator 2000 different from Figs. 23A and 23B will be 
described next. Figs. 24A and 24B are views showing 
examples of the zoom magnification ratio indicator 2000 
different from Figs. 23A and 23B. The zoom 
magnification ratio indicator 2000 shown in Figs. 23A 

25 and 23B can be scaled (i.e., the zoom magnification 
ratio indicator 2000 has a predetermined length) . 
However, Figs. 24A and 24B show display examples in 
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which the scale of the zoom magnification ratio 
Indicator 2000 Is fixed (I.e., the length of the zoom 
magnification ratio indicator 2000 changes). 

Fig. 24A shows a display example of the zoom 
5 magnification ratio Indicator 2000 when zooming can be 
executed in the electrical zoom 1 region 1907 and 
electrical zoom 2 region 1908 shown in Fig. 22. 
Referring to Fig. 24A, an indicator 2101 indicates the 
current zoom magnification ratio. A boundary line 2102 

10 indicates the upper limit of electrical zoom 1 (the 

boundary between the electrical zoom 1 region 1907 and 
the electrical zoom 2 region 1908 in Fig. 22). As 
described above. Fig. 24A corresponds to Fig. 23A 
described above, and the. display form and display 

15 contents are the same. 

Fig. 24B shows a display example of the zoom 
magnification ratio Indicator 2000 when zooming can be 
executed in the electrical zoom 1 region 1907 shown In 
Fig. 22. The zoom magnification ratio indicator 2000 

20 shown In Fig. 24B is shorter than that in Fig. 24A 

(even that In Fig. 23B) by a length corresponding to 
the electrical zoom 2 region 1908. The maximum 
telephoto state represented by "T" corresponds to the 
recording image 1904 in Fig. 22 when the meiximum 

25 magnification ratio Is "X2". 

The Image sensing element 102 is an area sensor 
which executes color image sensing and in which pixels 
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having a plurality to types of color filters are 
two-dimensionally arrayed. The image sensing element 
102 also has a plurality of types of driving modes 
which change in accordance with , e.g., the recording 
5 mode. More specifically, the image sensing element 102 
has a non- cumulative read driving mode in which still 
image data is photographed, and pixel data of all 
pixels are read out and a cumulative read driving mode 
in which moving image data is photographed, and pixel 
10 data in the vertical direction are mixed and read out, 
as described above. The present invention is not 
limited to the driving modes of the above -described 
types . The image sensing element may have any other 
driving modes . 

15 Various control circuits in the digital video 

camera shown in Figs . 1 and 2 may be implemented by 
dedicated hardware. Alternatively, some or all of the 
control circuits may be constituted by a memory and CPU 
(Central Processing Unit), and their processing may be 

20 implemented by loading a program to implement various 
kinds of processing in the control units in the memory 
and executing the program. 

The memory is constituted by a nonvolatile memory 
such as a hard disk device, magnetooptical disk device, 

25 or flash memory, a recording medium such as a CD-ROM 

which can only be read- accessed, a volatile memory such 
as a RAM (Random Access Memory), or a computer-readable 
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or writable recording medium as a combination thereof. 

The functions of various control circuits of the 
above -described embodiments are also implemented when 
an operating system (OS) running on a computer performs 
5 part or all of actual processing on the basis of 

instructions of a program read out by the computer. 

The functions of various control circuits of the 
above -described embodiments may also be implemented 
when program codes read out from a storage medium are 

10 written in the memory of a function expansion board 

inserted into the computer or a function expansion unit 
connected to the computer, and the CPU of the function 
expansion board or function expansion unit performs 
part or all of actual processing on the basis of the 

15 instructions of the program codes. 

The embodiments of the present invention have 
been described above in detail with reference to the 
accompanying drawings. Detailed arrangements are not 
limited to the above embodiments, and designs without 

20 departing from the spirit and scope of the present 
invention are also incorporated. 

As has been described above, in the signal 
processing apparatus according to the present 
invention, when the first mode is selected, and the 

25 first detection means detects that the telephoto side 
is continuously selected, first signal processing is 
executed. When the second detection means detects that 
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the Increase in magnification ratio of the image by the 
first signal processing has reached the limit, second 
signal processing is subsequently executed to enlarge 
an image. When the second mode is selected, even when 
5 the second detection means detects that the increase in 
magnification ratio of the image by the first signal 
processing has reached the limit, and the first 
detection means then detects that the telephoto side is 
continuously selected, the second signal processing is 

10 inhibited. The user can adjust the zoom ratio of the 
image by selecting the mode. The user can therefore 
select a zoom mode with a small degradation in image 
quality in electrical, zoom processing. 

In the image data generation apparatus according 

15 to the present invention, a maximum variable 

magnification ratio candidate selected by the user from 
a plurality of types of maximum variable magnification 
ratio candidates is set as the maximum variable 
magnification ratio. In addition, the variable 

20 magnification ratio change indication means indicates , 
as a boundary line, the value of a maximum variable 
magnification ratio candidate whose variable 
magnification ratio is lower than that of the maximum 
variable magnification ratio. Hence, the user can 

25 select a desired maximum image zoom ratio. That is, 
the user can select a zoom mode with a small 
degradation in image quality in electrical zoom 
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processing. Furthermore, since the value of the 
maximum variable magnification ratio candidate Is 
Indicated as the boundary line, the user can easily 
grasp the state or influence of electrical zoom 
5 processing, and therefore, user can more appropriately 
select a zoom mode with a small degradation in image 
quality in electrical zoom processing. 

As many apparently widely different embodiments 
of the present invention can be made without departing 
10 from the spirit and scope thereof, it is to be 

understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
appended claims. 
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